Efficient Implementations of the Generalized Lasso Dual Path Algorithm

نویسندگان

  • Taylor Arnold
  • Ryan J. Tibshirani
چکیده

The generalized lasso problem penalizes the `1 norm of a matrix D times the coefficient vector to be modeled, and has a wide range of applications, dictated by the choice of D. Special cases include the trend filtering and fused lasso problem classes. We consider in this talk highly efficient implementations of the generalized lasso dual path algorithm of Tibshirani and Taylor [1]. This covers both the generic case in which the penalty D is an arbitrary penalty matrix, and two specialized implementations when D corresponds to the trend filtering and fused lasso problem classes, respectively. We find that these specialized implementations offer a considerable improvement over the generic implementation, both in terms of numerical stability and efficiency of the solution path computation. These algorithms are all available for use in the genlasso R package, which can be found in the CRAN repository.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Solution Path of the Generalized Lasso

We present a path algorithm for the generalized lasso problem. This problem penalizes the `1 norm of a matrix D times the coefficient vector, and has a wide range of applications, dictated by the choice of D. Our algorithm is based on solving the dual of the generalized lasso, which facilitates computation and conceptual understanding of the path. For D = I (the usual lasso), we draw a connecti...

متن کامل

Variable Inclusion and Shrinkage Algorithms

The Lasso is a popular and computationally efficient procedure for automatically performing both variable selection and coefficient shrinkage on linear regression models. One limitation of the Lasso is that the same tuning parameter is used for both variable selection and shrinkage. As a result, it typically ends up selecting a model with too many variables to prevent over shrinkage of the regr...

متن کامل

Using the LASSO's Dual for Regularization in Sparse Signal Reconstruction from Array Data

Waves from a sparse set of source hidden in additive noise are observed by a sensor array. We treat the estimation of the sparse set of sources as a generalized complex-valued LASSO problem. The corresponding dual problem is formulated and it is shown that the dual solution is useful for selecting the regularization parameter of the LASSO when the number of sources is given. The solution path o...

متن کامل

A Proximal Point Algorithm for Log-Determinant Optimization with Group Lasso Regularization

We consider the covariance selection problem where variables are clustered into groups and the inverse covariance matrix is expected to have a blockwise sparse structure. This problem is realized via penalizing the maximum likelihood estimation of the inverse covariance matrix by group Lasso regularization. We propose to solve the resulting log-determinant optimization problem with the classica...

متن کامل

Introduction to the genlasso package

We present a short tutorial and introduction to using the R package genlasso, which is used for computing the solution path of the generalized lasso problem discussed in Tibshirani and Taylor (2011). Use cases of the generalized lasso include the fused lasso over an arbitrary graph, and trend fitting of any given polynomial order. Our implementation includes a function to solve the generalized ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1405.3222  شماره 

صفحات  -

تاریخ انتشار 2014